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We introduce a deterministic, time-reversible version of the Ehrenfest urn model. The distribution 
of first-passage times from equilibrium to non-equilibrium states and vice versa is calculated. We 
find that average times for transition to non-equilibrium always scale exponentially with the system 
size, whereas the time scale for relaxation to equilibrium depends on microscopic dynamics. To 
illustrate this, we also look at deterministic and stochastic versions of the Ehrenfest model with a 
distribution of microscopic relaxation times. 



I. INTRODUCTION 

Physical laws of motion are time reversible. As a con- 
sequence, from a movie of a few interacting particles one 
cannot distinguish whether the movie is running forward 
or backward. This seems to be different when we observe 
a very large number of particles. Macroscopic properties 
like the density of particles show a direction of time. If 
the milk in the coffee shrinks to a single drop we know 
that the movie is running backward. 

More than a hundred years ago Ludwig Boltzmann 
gave convincing arguments for the irreversible macro- 
scopic behaviour of particles moving with reversible mi- 
croscopic laws. The fraction of initial states which leads 
to reversible macroscopic behaviour is so extremely small 
that we will never be able to observe it. With probability 
one, we observe a time's arrow in macroscopic properties. 

Hence, through the selection of the initial state, the 
deterministic motion receives probabilistic elements. In 
fact describing a large system of interacting particles by 
either a stochastic motion (Boltzmann transport equa- 
tions) or ensemble theory (statistical mechanics) turned 
out to be very successful. 

However, the success of Boltzmann's ideas did not sup- 
press the discussion about the foundations of irreversible 
properties, even hundred years later ffl-pj. For exam- 
ple, there was a round table discussion on this subject 
on the STATPHYS 98 conference §,§, where Prigogine 
introduced novel microscopic laws which are irreversible 
with time. One reason for this ongoing discussion is the 
absence of rigorous mathematical proofs of irreversible 
properties in the thermodynamical limit. Furthermore, 
solvable models where irreversible macroscopic proper- 
ties can be well defined and investigated almost do not 
exist, to our knowledge. Either one studies stochastic 
models like the famous one of Paul and Tanja Ehrenfest 
H , or disorder averages as for the Kac ring |j| , or ensem- 
bles of chaotic noninteracting particles as in the Lorentz 
gas 0,0. However, a single trajectory of interacting 
particles is difficult to investigate in this context. 

Numerical simulations of the equations of motions do 
not help much in this context, either. The algorithms 
can be formulated in a time reversible way and the de- 



cay of Boltzmann's H-function has been demonstrated 
p^[ . However, the state space is too large to study any 
details, for instance to estimate the fraction of untypi- 
cal inital states or to find the time scale of the Poincare 
return time. 

One should keep in mind that we want to under- 
stand the property of a single trajectory for a short time. 
Hence, ensemble averages do not give a basic explana- 
tion of irreversible properties, since they contain an av- 
erage over infinitely many trajectories. Ergodic theory 
does not help either, since it needs time averages over 
infinitely large times (at least up to the Poincare return 
time) whereas real physical systems or computer sim- 
ulations run over time scales which are extemely short 
compared to the return time. 

In this paper we introduce a model with deterministic 
time reversible dynamics which can be analysed in detail. 
It is a deterministic extension of the Ehrenfest model dis- 



cussed in Section IV. The dynamics is ergodic, each state 



is visited once during a cycle. The Poincare return time 
is known exactly and the Boltzmann and Gibbs entropies 
can be defined precisely. From numerical calculations we 
obtain the distribution of first passage times the system 
needs to go from a non equilibrium state to a state with 
largest Boltzmann entropy as well as in the reverse di- 
rection. The scaling of average first passage times with 
system size is calculated. Finally we compare the results 
of the deterministic model with the corresponding ones 
of the stochastic version of the Ehrenfest model. 



II. DETERMINISTIC EHRENFEST MODEL: 
SHIFT REGISTER GENERATOR 



The microscopic state x of our model has N binary 
variables Xi S {0, 1}; i = 1, —,N, 



"(t) = (xi,x 2 , ...,x N ) . 



(1) 



The time t is discrete. At each time step a new bit 
xq is generated and replaces x\, whereas the old bits 
x\, . . . , xn-i are moved one step to the right: 



1 



Xi 



X2 



Xn-i— > a; TV 
x -> Xi 



(2) 



The last bit a; at is deleted. The new bit xo is con- 
structed using the theory of primitive polynomials mod- 
ulo two which is also used to generate pseudo random 
numbers 13 - . If xq is the sum modulo two of a few 
bits Xi at certain positions i, then any initial state x(0) 
runs through all possible states x except the state zero 
(0,0, ...,0). For instance for N — 97 one finds from the 
table of Ref. El: 



Xq = (xgj + Xq) mod 2 



(3) 



In our investigation we use such sequences with maximal 
cycle length, taking the generators from (li) for N < 100 
and from |L6j for higher N. 

For the macroscopic property M(x), which we will in- 
vestigate, we take the number of X4 = 1, 



JV 



(4) 



i=0 



Note that at each time step M changes by ±1 at most. 
The original Ehrenfest model considered N balls in two 
urns. Xi = 0(1) means that ball i is in the left (right) 
urn. M is the number of balls in the right urn. In the 
Ehrenfest model the balls were chosen randomly. Here we 
define a deterministic rule to move the particles between 
the two urns. 

The equations of motion (0) and (|3|) are time reversible; 
for instance from O) one finds 



£97 = (xq + xq) mod 2 . 



(5) 



Hence, from the first and seventh bit of state x(t+ 1) one 
calculates the 97 th bit of x(t), and a shift to the left gives 
the rest of x(t). 

We have now defined a model where time and states 
are discrete. It has the following properties: 

1. The equations of motion are deterministic and time 
reversible. 

2. Each initial state returns to itself after 2 N — 1 time 
steps; i.e. the Poincare return time is Tr = 2 N — 1. 

3. The Boltzmann entropy Sb is given by the num- 
ber of microstates x which have the macroscopic 
property M. Since the distribution of macrostates 
is the binomial distribution (with the exception of 
the zero state), 



p(M(x)) = 



N 
M{x) 



/{2 N -l), 



(6) 



one finds for the entropy in dimensionless units: 

( N 



S B (x) = In 



\M(x) 



(7) 



4. Since each state x is visited once during each cy- 
cle, it has an identical statistical weight in a Gibbs 
ensemble. Hence, the Gibbs entropy Sg is given by 



S G = ln(2 w - 1) ~ iVln.2 



(8) 



5. The system is ergodic. When the system is ob- 
served over the return time Tr, the time average 
M agrees with ensemble average (M); 



1 T « /v 

M=—Y J M[x(t)] = (M) = - 
R t>o 



(9) 



6. The most probable value of M agrees with time and 
ensemble average, 



M mp = M = (M) = ^ 



(10) 



There are 



U/2 



2 2 A 



~ Ttt (11) 



states x whith M(x) — M mp . We call these states 
equilibrium states. 

During a cycle, the average time interval between two 
consecutive equilibrium states increases with ^/N accord- 
ing to Eq. ph. 



III. MACROSCOPIC DYNAMICS 

We investigate the two following questions: 

1. When the system starts from an initial state x 
which is far away from equilibrium, for instance 
with M(x) = N/4, how long does it take to reach 
an equilibrium (= most probable) state? 

2. When the system starts from an equilibrium state, 
M(x) = N/2, how long does it take to reach a non- 
equilibrium state with M — N/4? 



We call these two time intervals first passage time T ( 



eq 

and T neq , respectively. Both of these times depend on 
the special choice of the initial state, therefore we obtain 
a distribution of first passage times. Fig. [t] shows the 
result for N — 24 which is obtained from simulations of 
all 2 24 — 1 states. The time T eq to reach an equlibrium 
state has a sharp peak around T eq ~ N . In contrast, 
the time to leave equilibrium has a broad distribution 
extending from the minimal possible time T neq = N/4 
to T neq — 5079. Since the system is time reversible, the 



2 



distribution of equilibrium times should be part of the 
distribution of non-equilibrium times T neq . In fact, we 
observe the corresponding peak in Fig. |l|. But surpris- 
ingly there are more equilibrium states which reach non 
equilibrium ones for the first time in short than in long 
times. The distribution of T neq has its maximum for val- 
ues of the order of TV, while the tail can be fitted to an 
exponential distribution 



P(t) cx e' t/T 



(12) 



where r is of the order of the average non-equilibrium 
time (T neq ), averaged over all initial equilibrium states. 
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FIG. 1. Distribution of first-passage times to equilibrium 
(N/2, solid line) and non-equilibrium (N/4, dotted line) in 
the 24-bit shift register. All states are counted; therefore 
the integral over the solid curve is ( 2 g 4 ) while that over the 
dotted curve is (^ . The inset shows the same curves on a 
semi-logarithmic scale. 

In Figs. and |^ it is shown how the average value 
of these times scales with system size TV. For small sys- 
tems N < 32 we average over all possible initial states 
whereas for large systems we average over several hun- 
dred randomly selected initial states. We obtain a good 
fit with 



(T eq ) = 1.307V- 12.3 
(T neq ) = 15.0 exp(0. 1467V) 



(13) 



Hence, the time to reach equilibrium is short, it scales 
with system size TV, whereas the time to reach a state 
far from equilibrium is very long and increases exponen- 
tially with TV. A lower bound on (T neq ) can be found for 



any system whose distribution of macrostates is the bino- 
mial distribution: take a sequence of (jvy 2 )/(jv/4.) ec l u i~ 
librium states followed by one nonequilibrium state with 
71/ = 7V/4, repeated as often as necessary. Incidentally, 
this lower bound differs only by a factor of ^j2/(nN) from 
the average return time of the non-equilibrium state. 



Choosing an initial occupation Mq = mN, the lower 
bound can be approximated for large TV using Stirling's 
Formula: 



(T neq ) > v/2m(l-m)(2m m (l - mf- m ) N 



(14) 



For M = N/4, this gives 

(T neq ) > V3 (3 3 / 4 /2) N « V3 exp(0.1317V) ; (15) 

the exponent is close to the fit given in Eq. (|l3|). To- 
gether with the upper bound (T neq ) < 2 N — 1 one obtains 
exponential scaling with TV. We find that usually T neq 
is proportional to the return time of the non-equilibrium 
state, with a proportionality constant that depends on 
the details of the generator (for example, if a two-tap or 
four-tap register is chosen, see Fig. ||). 
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FIG. 2. Mean first-passage times from M = 7V/4 to equi- 
librium for different sizes TV of the shift register and Ehrenfest 
model. 
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FIG. 3. Mean first-passage times from equilibrium to 
M = AT/3, AT/4 and AT/5, for different N of the shift register 
and Ehrenfest model. Two-tap shift generators were used for 
N = 20 and N = 60, while the other points are from four-tap 
generators. 

Fig. ^ shows the time dependence of the Boltzmann 
entropy Sb(x(£)), averaged over initial states with M = 
N/4 (non-equilibrium) and M = N/2 (equilibrium), re- 
spectively. The non-equilibrium entropy decays to its 
equilibrium value Sb — Sg in TV time steps, since ev- 
ery bit Xi is visited and "randomized" exactly every A^th 
time step. Starting from equilibrium states, the entropy 
stays constant. Note that after the Poincare return time 
Tr, Sb has to return to its initial value. But the time to 
reach equilibrium is of the order of the microscopic time, 
whereas the return time Tr increases exponentially with 
system size. 
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FIG. 4. Time development of the Boltzmann entropy Sb of 
shift registers with N = 48 and N = 96. Simulations averaged 
over 10 5 initial conditions with M = N/4 and M = N/2. 
The entropy relaxes to its maximum value in AT time steps. 



IV. STOCHASTIC EHRENFEST MODEL 

The original Ehrenfest model describes a stochastic 
process: N balls are distributed among two urns. At 
every time step, a ball is picked at random and moved 
to the respective other urn; M is the number of balls in 
one of the urns. This process can be mapped to a ran- 
dom walk with drift |L7|]. M is the position of the walker, 
who at each time step performs a step AM = ±1 with 
probability 



P(M -> M + 1) = (N - M)/M 
P(M — > M — 1) = M/N . 



(16) 



exist only between equilibrium states , whereas we are 
interested in the decay to or from non equilibrium states. 
We have calculated these times from numerical iteration 
of the corresponding transition matrices using absorbing 
states 1 19 . The average times for different system sizes 
are shown in Figs. || and [}] in comparison with the corre- 
sponding deterministic model; the distribution of times 
for N — 24 is shown in Fig. |[ Again, the decay time T eq 
to equilibrium scales with N (although with more pro- 
nounced finite-size effects) while the time to reach a non 
equilibrium state from an equilibrium one increases expo- 
nentially with system size. Indeed the stochastic model 
has similar properties as the deterministic one. 
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Hence, there is a drift towards the center M — N/2. To 
our knowledge, analytic calculations of first passage times 



FIG. 5. Distribution of first-passage times in the stochastic 
Ehrenfest model, using the same normalization as in Fig. [j]. 



V. HIERARCHICAL DYNAMICS 

There are several deterministic algorithms which 
change only one bit per time step and run through all 
of the 2 N configurations of the bit sequence x. One of 
them is the Gray Code jL4j: Find the largest power 2 J 
by which the discrete time t is divisible and change bit 
Xj-+i. The quantity M changes by ±1 only, and the sys- 
tem runs through all of the 2 N possible states. However, 
now the access to the different variables Xj is hierarchi- 
cal; it takes 2 J+1 steps before site j is visited again. This 
hierarchical structure of microscopic dynamics leads to 
slow relaxation times of the macroscopic property M, as 
shown in Fig. |^. The time to reach an equilibrium state 
from an initial non-equilibrium one scales exponentially 
with system size N. 

There is a corresponding stochastic version of the Gray 
code: 

• Start with j = 1; 

• with probability 1/2, increase j by 1; else flip Xj, 
increase t by one and return to the first step; 
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• if j > N, increase t and return to the first step; else 
repeat the second step. 



The ensemble average of M decays as 



JV 



(M) = N/2 + ^2(M /N - 1/2) exp(-t/2 



(17) 



The simulations of the stochastic model agree with Eq. 
(|T7j); however, in the deterministic Gray code, (M) shows 
structures caused by "almost returns" after times that 
are multiples of high powers of 2 (see Fig. ||). The first 
passage times of the stochastic model show a similar ex- 
ponential scaling as the corresponding times of the de- 
terministic model (see Fig. ^). 
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FIG. 6. Relaxation of (M) in the Gray code and corre- 
sponding stochastic model, compared to Eq. (^) . Relaxation 
times are exponential in N. 
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FIG. 7. In the Gray code and corresponding stochastical 
model, times for transition to equilibrium are exponential in 
N, with identical exponents but different prefactors. 



It is possible to have a quadratic dependence on N of 
the decay time of (M(t)) by the following stochastic al- 
gorithm: 

Draw a uniform random number r G [0, 1] and flip Xj 
with the largest index j < 1/r, if j < N. 
The probability to flip Xj is of order 1/j 2 . The average 
value of M(t) decays as 



(M) a N/2 + (M /N - 1/2) [(N + 1) exp( 



2t 



exp(-2t) 



(A+l) 2 ' 
erf(V2t))]. (18) 



The long term behaviour is determined by the longest 
decay constant, which is —2/(N+ l) 2 . We have also cal- 
culated the first passage time to equilibrium, and find 
that it scales with iV 2 . 



VI. SUMMARY 



A simple model with time reversible deterministic dy- 
namics is investigated. The Poincare return time is 
2^ — 1, where N is the size of the system; each initial 
state returns to itself after 2 N — 1 time steps. We define 
a macroscopic quantity M(t) and study its time depen- 
dence. When the system starts from an equilibrium state 
(state with most probable value of M) it takes on aver- 
age an exponentially large time before it reaches a state 
far from equilibrium. On the other side, when the system 
starts far from equilibrium it reaches an equilibrium state 
after a period of the order of the microscopic time. The 
same is true for the corresponding Boltzmann entropy. 
This behaviour explains the time's arrow in macroscopic 
properties for a system with time reversible dynamics. 

We have calculated the full distributions of these first 
passage times and compared them to the ones of the 
corresponding stochastic Ehrenfest model. Surprisingly 
the distribution of times the system needs to reach non- 
equilibrium for the first time reaches a maximum at 
times of order iV and monotonically decreases for larger 
times. However, the integral of T neq over short times is 
small compared to the total number of equilibrium states. 
Therefore, on average the time to leave equilibrium scales 
exponentially with system size. If our computer needs 
10 6 steps per second, Eq. ( |l5|) gives the age of the uni- 
verse for N » 400. Even for our simple model the return 
to non-equilibrium cannot be observed in reasonable time 
for N significantly larger than 70. 

All these results hold only for a model with identical 
microscopic times for all of the local variables. We have 
also studied models with hierarchical or power law ac- 
cess times. In these cases the relaxation to equilibrium 
is slowed down. The time to reach equilibrium scales ex- 
ponentially or with a power of system size, depending on 
the distribution of microscopic times. 
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